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Abstract 

Branching Processes in a Random Environment (BPREs) {Z„ : n > 0) are a generalization 
of Galton Watson processes where in eacli generation the reproduction law is picked randomly 
in an i.i.d. manner. We determine here the upper large deviation of the process when the 
reproduction law may have heavy tails. The behavior of BPREs is related to the associated 
random walk of the environment, whose increments are distributed like the logarithmic mean 
of the offspring distributions. We obtain an expression of the upper rate function of {Zn ■ 
n > 0), that is the limit of — logP(Z„ > e*")/n when n — !> oo. It depends on the rate 
function of the associated random walk of the environment, the logarithmic cost of survival 
7 ~ — lim„_^tx) logP(Z„ > 0)/n and the polynomial decay /? of the tail distribution of Zi. 
We give interpretations of this rate function in terms of the least costly ways for the process 
{Z„ : n > 0) of attaining extraordinarily large values and describe the phase transitions. 
We derive then the rate function when the reproduction law does not have heavy tails, which 
generalizes the results of Boinghoff and Kersting (2009) and Bansaye and Berestycki (2008) for 
upper large deviations. Finally, we specify the upper large deviations for the Galton Watson 
processes with heavy tails. 

AMS 2000 Subject Classification. 60J80, 60K37, 60J05, 92D25 
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1 Introduction 

Branching processes in a random environment have been introduced in [1] and |23| . In each gen- 
eration, an offspring distribution is chosen at random, independently from one generation to the 
other. We can think of a population of plants which have a one year life-cycle. Each year the 
weather conditions (the environment) vary, which impacts the reproductive success of the plant. 
Given the climate, all the plants reproduce independently according to the same mechanism. 
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Initially, these processes have mainly been studied under the assumption of i.i.d. offspring distri- 
butions which arc geometric, or more generally, linear fractional [Tl I20j. Then, the case of general 
offspring distributions has attracted attention |3l [6l [101 US] ■ 

Recently, several results about large deviations of branching processes in random environment 
for offspring distributions with weak tails have been proved. More precisely, |21| ensures that 
F{Zn > exp{9n)) is equivalent to /(0)P(S'„ > On) for geometric offspring distributions and 9 large 
enough. In [7|, the authors give a general upper bound for the rate function and compute it when 
each individual leaves at least one offspring, i.e. F{Zi = 0) = 0. Finally [TT] gives an expression of 
the upper rate function when the reproduction laws have at most geometric tails, which excludes 
heavy tails. 

Exceptional growth of BPREs can be due to an exceptional environment and/or to exceptional 
reproduction in some given environment. In this paper, we focus on large deviation probabilities 
when the offspring distributions may have heavy tails and the exceptional reproduction of a single 
individual can now contribute to the large deviation event. This leads us to consider new auxiliary 
power series and higher order derivatives of generating functions for the proof. 

Let us give now the formal definition of the process {Zn : n G N), N = {0,1,2,3,...}, by 
considering a random probability generating function / and a sequence (/„ : n > 1) of i.i.d. 
copies of / which serve as random environment. Conditionally on the environment (/„ : n > 
1), individuals at generation n reproduce independently of each other and their offsprings have 
generating function /„+!• We denote by Z„ the number of particles in generation n and Zn+i is 
the sum of Z„ independent random variables with generating function fn+i- That is, for every 
n > 0, 

E[s^"+i|Zo,...,Z„; /i,...,/„+i] =/„+i(s)^" a.s. (0 < s < 1). 

In the whole paper, we denote by the probability associated with k initial particles and then, 
we have for all fc G N and n G N, 

Efe[s^" I /i, /„] = [/i o . . . o /„(s)]^ a.s. (0 < s < 1). 

Unless otherwise specified, the initial population size is 1. 

We introduce the exponential rate of decay of the survival probability 

7 := lim -ilogP(Z„ > 0) . (1) 

The fact that the limit exists and < 7 < oo is classical (see [TT]) since the sequence (— logP(Z„ > 
0))„ is subadditive and nonnegative (see [12]). Essentially, 7 = in the supercritical or critical 
case {E{X) < 0) and 

7 = - log ( inf{E(exp(sX) ; s G [0, 1]}) 

in the subcritical case. In this latter case, 7 — — log(E(/'(l))) in the strongly or intermediate 
subcritical case) (E{X cxp{X)) < 0) whereas 7 > — log(E(/'(l))) in the weakly subcritical case 
{E{X exp(X)) > 0). We refer to [2] for more precise asymptotic results on the survival probability 
in the subcritical case. 

Many properties of Z are mainly determined by the random walk associated with the 
environment 

5*0=0, Sn-Sn-l=Xn {n > 1) . 
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where 

X„ := log(/,;(l)) (n>l), 
are i.i.d. copies of the logarithm of the mean mimber of offsprings 

X := log(/'(l)) 
If = 1, we get for the conditioned means of Z„ 

E[Z„ I /!,...,/„] = e^" a.s. (2) 

In the whole paper, we assume that there exists s > such that the moment generating function 
E[cxp(sX)] is finite and we introduce the rate function A of the random walk [Sn : n 6 N) 

k{e) := sup{Ae'-log(E[cxp(AX)])} (3) 

A>0 

As A is convex and lower semicontinuous, there is at most one 6* > with h.{6) ^ A(0+). In 
this case, A(^^+) = oo (see e.g [TH], Usually, A is defined as the Lcgendretransform of 

log(E[exp(AX)]) and the supremum in ^ is taken over all A G R. Here, we are only interested in 
upper deviations, thus setting A(0) = for B < E[X] is convenient. □ 

We write L ~ L{f) for the random variable associated with the probability generating function /: 

I /] = f{s) (0 < s < 1) a.s. 
and we denote by m = m(/) its expectation: 

TO /'(I) = E[L|/] < oo a.s. 

2 Main results and interpretation 

We describe here the upper large deviations of the branching process (Z„ : n e N) when the 
offspring distributions may have heavy tails. This means that the probability that one individ- 
ual gives birth to an exponential number of offsprings may decrease 'only exponentially'. More 
precisely, we work with the following assumption, which ensures that the tail of the offspring dis- 
tribution of an individual, conditioned to be positive, decays at least with exponent /3 € (l,oo) 
(uniformly with respect to the environments). 

Assumption ?^(/3). There exists a constant < d < oo such that for every z > 0, 

F{L>z\f,L>0) < d-{mAl)-z-^ a.s. 
The rate function ijj we establish and interpret below depends on 7, /3 and A and is defined by 

m--= ini {t^ + (5s + il-t)Aiie-s)/il-t))} {=4'y,p,Am- (4) 
Note that in the supercritical case (i.e. E[log(/'(l))] > 0), ip simplifies to 

i;(e) = inf {/3s + A(9-s)}. 
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Theorem 1. Assume that for some p G (1,cxd), log(P(Zi > z))/log(2) ^ — ^ —(3 and that addi- 
tionally 'H{l3) holds. Then for every > 0, 

-ilog(P(Z„>e'^"))"-^VW- 
n 

The assumptions in this Theorem ensure that the offspring distributions associated to 'some en- 
vironments' have polynomial tails with exponent — /3, and no tail distribution exceeds this exponent. 

The upper bound is proved in section 3, while the proof of the lower bound is given in sections |4] 
and [5] by distinguishing the case (3 e (1,2] and the case /3 > 2. The proof for /? > 2 is technically 
more involved since it requires higher order derivatives of generating functions and we adapt in 
section [S] the arguments of the proof for f3 G (1,2]. 

Remark: This theorem still holds if we just assume that there exists a slowly varying function I 
such that 

P(L > z I /, i > 0) < d ■ (m A 1) • l{z)z-'^ a.s. 

instead of assumption H(/3). Indeed, by properties of slowly varying functions (see [5], proposi- 
tion 1.3.6, page 16), for any e > 0, there exists a constant de such that P(i > z | /, L > 0) < 
de-{m,Al)-z~^~^'^ a.s. As for fixed 6 > 0, ip^y.p^A is continuous in f3, letting e — > yields the claim. □ 

Let us give two consequences of this result. First, we derive a large deviation result for 
offspring distributions without heavy tails by letting /? — > cxj, which generalizes Theorem 1 in [11) . 

Corollary 1. // assumption H(/3) is fulfilled for every (3 > 0, then for every 9 > 0, 

-ilog(P(Z„ > e"")) inf {tj+{l-t)A{e/{l-t))}. 

n te[o,i] 1^ J 

For example, this result holds if the offspring distributions are bounded {¥{L > a \ f) ~ a.s. for 
some constant a) or if P(L > z \ f, L > 0) < cexp(— z") a.s. for some constants c, a > 0. 

Second we deal with the Galton Watson case, so the environment is not random and / is 
deterministic, meaning A{d) = cxd for > log to and A(logm) = 0. . We refer to |S1[52] for precise 
results for large deviations without heavy tails. For the decay rate of the survival probability, it is 
known that (see [5]) in the subcritical case (m < 1) 

7 = — log TO 

and 7 = in the critical (to = 1) and supercritical (m > 1) case. Thus, in the subcritical case, 

ip{e) = -\ogm + pe. 

In the critical and supercritical case, it remains to minimize 

ip(e) = inf {(3s + A(e-s)} , 
s£lo,e] 

where A{9) = for 9 < log to and A{6) = cxd for 6 > logm. Hence, 

i}{9) = /3(6i- log to) . 
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Path interpretation of the rate function. The rate function gives the exponential decay rate 
of the probability of reaching exceptionally large values, namely 



P(Z„ > 6ln) = exp(-V(^')"- + o(n)). 

We consider the following 'natural paths' which reaches extraordinarily large values, i.e a path 
which realizes {Z„ > exp{9n)} for 71 ^ 1 and 9 > E[log(/'(l))]. At the beginning, up to time 
[tn\ , there is a period without growth, that is the process just survives. The probability of this 
event decreases as exp(— 7[tnJ). At time [inj, there are very few individuals and one individual 
has exceptionally many offsprings, namely exp(sn)-many. The probability of this event is given by 
V{Zi > exp(sn)) so it is of the order of exp(— /3sri). Then the process grows exponentially accord- 
ing to its expectation in a good environment to reach exp(07i). That is S grows linearly such that 
Sn — '5'[,itj ~ [9 — s]n and the probability to observe this exceptionally good environment sequence 
decreases as exp(— (1 —t)A{{9 — s)/ (1 — The most probable path to reach extraordinary large 

values exp{9n) at time n is then obtained by minimizing the sum of these three 'costs' jt, /3s and 
(1 — t)A{{9 — s)/(l — t)), which gives the rate function ip. 



The optimal strategy to realize the large deviation event is given by the bivariate value {tg, sg) 
such that 

- to-/ + lisg + (1 - te)K{{9 - se)l{l - tg)) . 

More formally, following the proof of |7], we should be able to prove the uniqueness of {tg,sg) 
(except for degenerated situations) and the forthcoming trajectorial result. But the proof become 
very heavy and technical. Conditionally on Z„ < e^", we expect that 

sup {| log(Z[t„])/n - "lIS? q 
te[o,i] 

in probability in the sense of the uniform norm where 

I P-'^B + T^^{t-tg), iit>tg. 

Figure 1. Representation of t E [0, 1] fe{t)- 




As detailed in the next paragraph, several strategies may occur following the regime of the process 
and the value of 9. Except in degenerated cases when the associated path is not unique, wc prove 
below using convexity arguments that the jump occurs at the beginning {sg > ^ tg ~ 0) or at 
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the end {tg ~ 1) of the trajectory. Thus upper large deviation events correspond to one of the 
following trajectories. 

Figure 2. Representation of the possible trajectories of the path associated to upper large devia- 
tions. 




Obviously, keeping the population size small during a first period (tg > 0) and growing later 
(Figure [2] a)) can be relevant only in the subcritical case. Actually we see below that the situation 
from Figure [D a) only occurs if the process is strongly subcritical, as previously observed in [TT] 
without heavy tails. In the subcritical case, if A'(0) > /3, the associated optimal way is to keep 
the population size small by just surviving until the final time and then jump to the final value 
(Figure [2] d)). Then the population of size cxp(6'n) comes from a single parent of one of the last 
generations. The phase transitions arc described later. 

In the supercritical case (E[log(/'(l))] > 0), the process does not stay at zero {tg = 0) but may 
jump at time t = 0, and then goes in straight line to reach 9. This corresponds to Figure [5] b) and 
c). 

In the Galton Watson case with mean offspring m, the good strategy is either to survive until the 
final time and jump to the desired value (if to < 1), or to jump to — log(TO) and then grow 
normally (if m > 1). 

Graphical construction of the rate function. Here, we give another characterization of ip, 
which will be useful to describe the strategy for upper large deviations in function of 6. As proved 
in Lemma [3] (see appendix), ip is the largest convex function which satisfies for all a;, ^ > 

^(o) = 7, Tjj{0)<A{e), ij{e + x) <Tp{0) + i3x. 

The first condition plays a role iff A(0) > 7, which corresponds to the strongly subcritical 
case (i.e. E[/'(l) log(/'(l))] < 0, see [H]). Indeed if E[X exp{X)] < 0, then the differentia- 
tion of s — > E[cxp(sA')] in s = 1 is negative and A(0) = sup{— log(E[exp(sA)]) : s > 0} > 
- log(E[exp(A)]) = 7. If E[Aexp(A)] > 0, [H] and the definition of A ensure that both 7 and 
A(0) are equal to — log(E[cxp(:/A)]) where ly is characterized by E[Acxp(j/A)] = 0. 
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This characterization leads us to construct ?/' by three pieces separated by 9* and 6*^ . 
Figure 3. The following picture gives ip in the strongly suhcritical case: 




More expHcitly, we define x '"^ the largest convex function which satisfies 

x(o) < 7, x{o) < m 

for all > 0. This function is the rate function of Z in case of offspring distributions having at 
most geometric tails (see [TT]) and is given by 



xio) = 

where < 0* < oo is defined by 



7(i-^) + ^A(r) , iie< 

A{e) , else 



A(r)-7 ^ 



Now define 

6»t = sup |6l > max{0,E[X]} : < /3 and xl^*) < ooj. (6) 

Then 

m = h^'^ ' . (7) 

\ /?0-log(E[e'9^]) , else 

Phase Transitions Let us first describe the phase transitions (of order two) of the rate function 
and the strategics associated with when 6*^ > 0. For that we use the following expression, 

7(l-f) + ^A(r) , ii9<9* 
ip{9) = { A{9) , if 0* < 61 < 6it . 

/3(6i - 6it) + A(6it) , if9>9^ 

which can be guessed from the previous picture and is also proved in the first section of the 
Appendix. 
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For 9 < 6* , the rate function ip is identical with x- This means that no jump occurs. 
ConditionaUy on the event {Z„ > exp(0n)}, the process first 'just survives with bounded values' 
until time \ ten\ [tg e (0, 1)). Then it grows within a good environment such that Sn — S^^tgn] ~ (^n- 
(see Figure [5] a) ) . When 9 increases, the survival period decreases whereas the geometric growth 
rate of the process remains constant and is equal to 9* . 

For 9* < 9 < 9\ ip is equal to A. Thus, conditionally on the large deviation event, the process 
grows exponentially (respectively linearly at the logarithmic scale) from the beginning to the end 
(see Figure [2]b)). This exceptional growth is due to a favorable environment such that Sn ~ 9n. 

For 9 > 9\ the trajectory associated with begins now with a jump : Zi « exp(s?i). Then it 
follows an exponential growth which corresponds to a favorable environment Sn ~ {9 — s)n (see 
Figure [2] c)). When 9 increases, the initial jump increases whereas the rate of the exponential 
growth is still equal to 9^ . 

The case 9^ = corresponds to ip{9) = 7 + (39. Here the good strategy consists in just 
surviving until the end and in one of the prelast generations, one individual has exp(0n)-many 
offsprings (see Figure [2] d)). 

Finally, we note that in the case < 9 = 9* = 9^ , the best strategy is no longer unique. Indeed, 
for any t e (0, 1], there exists s G [0, 9] such that all the following trajectories have the same cost. 
First, the process remains positive and bounded until time [tnj (survival period), then it jumps 
to exp(s7?) and grows exponentially with a constant rate (see Figure [Ij. 

Figure 4. Representation of t £ [0, 1] — >■ feit) in the strongly subcritical case for 9i < 92 < 9j, = 
9* <94<95 = 9^ <9e< 9j. 




Notations: Unless otherwise is specified, we start the branching process from one single individual 

and denote by P the probability associated with. We denote by the probability when the initial 

size of the population is equal to k. Large deviations results actually do not depend on the initial 

number of individuals if this latter is fixed (or bounded) . 

In the whole paper, we denote by 11 (/i, /2, . . .) the complete environment. 

For simplicity of notations, we are using several times <c to indicate that the inequality holds up 

to some multiplicative constant (which does not depend on any variable). 
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3 Proof of the upper bound of Theorem 1 

For the proof of the upper bound of Theorem [Tl we need the following result. It ensures that 
exceptional growth of the population can at least be achieved thanks to some suitable good en- 
vironment sequences, whose probability decreases exponentially following the rate function of the 
random walk {Sn : n E N). This result generalizes Proposition 1 in [7] for an exponential initial 
number of individuals. With a slight abuse, we denote below by exp(sn) the initial number of 
individuals instead of the integer part of exp(sn). 

Proposition 1. Under assumption H{f3), for all 9 > and < s < 9, 

limsup-i logPoxp(sn)(^n > exp(6'n)) < A{{9 - s)+) . 



Proof. For every 0' > 0, we recall that 

A{9') = sup{X9' - logE[exp(AX)]}. 

A>0 

First, we assume that E[cxp(AX)] < oo for every A > 0. Then the derivative of A — > 
E[exp(AX)] exists for every A > and the supremum is reached in A = Ag/ such that 

^, ^ E[Xexp{Xg,X)] 
E[exp(Ae'X)] 

Following classical large deviations methods and more specifically [7] , we introduce the probability 
P defined by 

Under this new probability, {Sn ■ n E N) is a random walk with drift E[X] = 9' > and Z„ is a 
supercritical BPRE. 

For aU n > 1, 6* e [0, 9') and e > 0, 

IPcxp(s«)(^n > cxp([6' + s]n)) 

> Pcxp(.„) {Zn > Gxp([0 + s]n); Sn < {9' + e)n) 

= E[exp(A6('X)]"Ecxp(sn) [exp(-A6('5„)]l{5,^<(6)/+g)„^ Z„>cxp([e+s]n)}] 

> exp {n[\og{E[cxp{Xg,X)] - Xg,{9' + e)] )Pcxp(.«) (^n > cxp([0 + s]n), Sn < {9' + e)n) 
>exp(n[-A(0')-A9'e])[Pcxp(.s„)(^n >cxp([0 + s]n)) -P(5„ > {9' + e)n)]. 

As P(5„ > {9' + e)n) — > when n cxo, we just need to prove that 

liminf Pexp(s„) (Zn > cxp{[9 + s]n)) > 0. (8) 
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so that we can conclude the proof by letting e 0,9' ^ 9. 



Relation ([8]) results from the fact that under P the population Z„ starting from one single individual 
grows as exp(5„) x n9' on the non-extinction event. More precisely, individuals of the initial 
population are labeled and the number of descendants in generation n of individual i is denoted 

(i) 

by Zn ■ Introduce then the 'success' probability p„: 

Pn = Pi{Zn > Ncxp{n9) I n) a.s. 

Then, conditionally on 11, for > 1, the number of initial individuals whose number of descendants 
in generation n is larger than N cxp{n9), 

Nn #{!<«< exp(sn) : Z^'^ > Ncxp{n9)}, 

follows a binomial distribution of parameters (exp(sn),p„). Moreover, as E[A^„ | 11] = e'^^pn a.s., 

Pcxp(s„)(^« > CXp([0 + S]n)) > Pcxp(.„)(^n > CXp(sn)/iV) > Pexp(.„) f^n > ' ■ 

V i V Pfi / 

Using the classical inequality due to Paley and Zygmund for r e [0, 1] (see e.g. [TO] page 63), 



V{Y>rE[Y]) > (1-r) 



2^1 

E[r2] 



(9) 



and adding that E[iV,j | 11] = e'^'^'^p^ + e''"p„(l -_p„) a.s., we get 



EjNn I n] 

Npn 



n > 



1 - 1 A 



Npn 



■nN„ I n]2 
m?. I n] 



> 



Now, we use that under assumption H{(3), 

i[^fc''P(L = k I /)/m] < i[^rP(L = fc I /, i > 0)] < cx), 

fcGN feeN 

for every 1 < s < /3. So Theorem 3 in [T7] ensures that for every N eN, 

E[Pn] = > cxp(6'n)) "-^ ]Pi(V?i G N : Z„ > 0) > 0. 

As the right hand side does not depend on A^ > 1, we have for A^ large enough 

5 := liminfP(p„ > 2/N) > 

and get 



lim inf I 



cxp(s?i) 



(Z„ > exp([6' + s]n)) > liminf E 



[1 - 1 A 1/Np„ 



l + N/2 



(5 1 - 1/2 2 

> > 0, 

- 1 + N 2 



which proves (|8]) and ends up the proof when E[exp(AX)] < oo for every A > 0. The general case 
follows by a standard approximation argument (see e.g. [TT| pages 10/11). □ 

Proof of the upper bound in Theorem]^ The proof amounts now to exhibit good trajectories which 
realize the large deviation event {Z„ > exp(0n)}. For every t S (0, 1) and s S [0,6*], by Markov 
property. 



P(Z„ > exp(0n)) > nZ[tn] > 0)P(Zi > cxp(sn))P,,p(,„) (Z„_[t„] > exp(0n)). 
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First, by (P, 

-^log(P(Z[,„] >0))"^7. 
Second, using that that log(P(Zi > z))/log(z) ^-^1^ _ we have 

-ilog(P(Zi > exp(sn))) ™ s/3 . 
n 

Finally, by Proposition [1] we get that 

limsup-— ^—log(Pexp(5„)(^„-[t„] > cxp{9n))) < A{{e - s)/(l - t)+) 

since 

IPcxp(sn)(^n-[tn] > CXp(6'n)) = Poxp(s/(l-t).(l-t)n) (^n-[tn] > CXp(n(l - t)9/{l - t))) . 

Combining the first inequality and the last three limits ensures that 

limsup -i log(P(Z„ > expfeiTi))) < inf \t-f + /3s + (1 - t)A((0 - s)/(l - t)+)]. 

n->-oo n tG[0,l],sG[0,e] L J 

As convex nonncgative function, A has at most one jump (to infinity). Thus the above infimum is 
To see this, we only have to consider the jump point. Say, there are se G [0, 9\ and tg G [0, 1) 
such that 

+ Pse + (1 - tg)A{{e - se)/{l - tg)) = ae) < oo 

and K{{6 — sg)/{l — tg)+) = oo. Then, as {6 ~ sg)/{l — tg) is the only jump point, for any e > 
there is a (5 > such that 

V-W-e < tg^ + l3isg-6) + {l-tg)A{{6-Sg-6)/{l-tg) + ) 
= tg-1 + P{sg ~5) + {l~ tg)A{{e ~ Sg ^ 5) / [l - tg)). 

Now letting e ^ Q proves the result and thereby the upper bound of Theorem [1] □ 

4 Proof of the lower bound of Theorem 1 for (5 G (1,2] 

We introduce the minimum of the associated random walk up to time n: 

Mn := min Sk a.s. 

0<fe<n 

Using that P(Z„ > 0|n) < E[Z„|n] = exp(S'„) and P(Z„ > 0|n) decreasing a.s., we get the 
following classical inequality (see e.g. [TU] ) 

P(Z„ > 0|n) < e^^" a.s. (10) 

Actually, the above estimate gives the correct exponential decay rate (see e.g. |10p: 

7 = - lim -logP(Z„ > 0) = - lim -logEfe*^"]. 

n— ^oo fi n— foo fi 

In Lemma [U the above relation is generalized and proved rigorously under assumption Ti{/3). 
For the proof of the lower bound of the main theorem, we need the following key bound for the 
tail probability of Z„. 
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Theorem 2. Under assumption 'H{(3) for some (3 £ (1,2], there exist a constant < c < oo and 
a positive nondecreasing and slowly varying function T such that for all k > 1 and n > I, 

P(Z„>fc|n) < cnr'5lT(n2/(^-i)e-^^"fc)e^^"(e^"-^^"/fc)'' a^- 



Let us explain briefly this result. The probabihty to survive until time n evolves as exp(Af„), nice 
environment sequences correspond to large values of (5„ — M„) and high reproduction of the initial 
individual gives the last term k~^. Conditionally on the environment sequence and the survival 
of the process, the growth of the process follows exp(iS'„ — Af„) : this corresponds to 'best period' 
in time for the growth of the process. Thus, this theorem essentially says that conditionally on 
Zn > 0, the tail distribution of Zn/e^"~^^" is at most polynomial with exponent —f3. 
Recalling that IT = (/i, /2, ...) and fn{s) is probability generating function of the offspring distri- 
bution of an individual in generation n — 1, we have 

oo 

/o,«(s):=5I'^M^« = ^'|n)=E[s^"|n], a.s. (0 < s < 1). (11) 

k=0 

For the proofs, it is suitable to work with an alternative expression, namely for every n > 1, 

5n(s):-i-^ a.s. (0<s<l) 

1 — s 

and 

5o,n(s) ^s'^P(Z„>fc|n) = i^^^ a.s. (0 < s < 1). (12) 

k=Q 

Moreover we need the following auxiliary function defined for every ^ g (0,1] by 

h 1 1 9k{ir-gk{sr ... 

(l-/fe(s))^ (./I-(l)(l - s))^ {9k{X)gk{s){l - s)Y 
Finally, we define for all 1 < fc < n, 

Uk {f[{l)---f'Al)V' = /^.,(1)-^ = e-^^ 

/fc,ri := ./fc+1 o /fc+2 o • • ■ o /ri, < k < n; fn^n = id a.s. 

By a telescope summation argument similar to jl3j . we have 

1 _ ui; 



il~foA-^)y (l-/0,n(s))^ 

n— 1 / Y 



(1 - fnAs)Y fkAs)Y (1 - fk+iA^)Y 

T7 — 1 

x-4 / 1 



i^-^r to ' V(l-A+l(A+l.n(s)))^ {fU,{l){l-fk+l.n{sW 

7YZTvr + Et^i^VfcH-i(A-+i.n(^)). s>o. (14) 

^ ' fe=0 



12 



Proof of Theorem\^ In the same vein as jllj . we are obtaining an upper bound for P(Z„ > ^jll) 
from the divergence of 5o^„(s) = J2jLoj^i^n > j\^)s-'~^ as s — )• 1. In that purpose, we use ([H]! 
for yu = /? — 1 and get 



^l/(/3-l) 



nis) = (ut' + {l-sf-'Y.^k~'h-uk+i{fk+i,n{s))) (0<s<l) a.s 



50/ 

k=0 

Then we calculate the first derivative of go,n- 



-l-l/il3~l) 



5o,„(s) 

fc=0 
n-1 

X ( - (/3 - 1)(1 - sf-' E t^f 

k=0 

n-1 

+ (1 - E "'/*^-l,fc+l(A+l,"(^))/^+l.n(^)) 

fc=0 

Now Lemma |4] in the appendix ensures that there exists c > such that for every s G [0, 1) 



hfi-iA^) < cT(l/(l-s)), (16) 
-h'p-iA^) < cT(l/(l-s))/(l-s) a.s. (17) 

Moreover, using ((H]), Lemma|l]in the appendix for < yU < /3 — 1 and Uk < exp(— A^„) for every 
< fc < n, there exists a c > 1 such that for every s e [0, 1), 



< -+nce-^'"" <ce-'^"""(n + l)/(l-s)^ a.s. 



(l-/,+i^„(s))M - (l-s)M 
Combining this inequality with (jl6p ensures that there exists c > such that 

hfi-x,u+i{fk+i.As)) < cT((n + l)i/^e-^^"(l-s)-i) (0 < 5 < 1) a.s. 

Moreover, fk+i.n{s) < 1 — f'^^i „(s)(l — s) by convexity of fk+i,n and (fTTl) ensures that 

- /»^-l,;o+l(A+l,n(.s))/^+i,„(s)(l - S) < C /^+i,„(s)(l - S)T(1/(1 - /fe+l.n(g))) / 

< c T((n + l)i/^e-^^"/(l " s)) (0 < s < 1) a.s. 
Using the two last estimates with /i = (/? — l)/2 together in yields 

ne-(^-i)^^'^T((n+l)2/(/^-i)e-^^"(l-s)-i) ^ 
forjS < c ^ '-^ 0<s<l a.s. 

Moreover for all fc > 1 and s 6 [0, 1], 



k 



j=k/2 

> s'^— P(z„ > fc|n). (18) 



13 



By letting s = 1 — l//c in the two last inequalities, we get 

1-7 ^P(^n>fc|n) < c- \ y ' ! 



which ends up the proof since Un = cxp(— S'„). □ 



For the proof of the lower bound of the Theorem [U we also need the following characterization of 
the 'survival cost' 7: 

Lemma 1. Under assumption 'H{j3), for all 6 > 0, b > and T positive nondecreasing and slowly 
varying at infinity, 

1 



7 = - lim -logErT(n''e''"e-^^")e^^"] 



Proof of Lemma\^ First let T = 1. We use with some Q < < (3 — 1 and (|55)) ensures that 

1 



p(z„>o|n) > 



For the upper bound, we use (|10p and get 

7 = - lim -logP(Z„ > 0) = - lim -logETe*^"]. 
As T is nondecreasing, 

7 > limsup--logE[T(n''e^"e-^^")e^^"]. 

For the converse inequality, we use that E[e**^"] is nonincreasing in n to define 

:= - lim ilogEfe*^^"] . 

We note that ^(t) > and by Lemma V.4 in [18], £,{t) is finite and convex. So ^ is continuous. 
Now by properties of slowly varying sequences (see [5], proposition 1.3.6, page 16), for any (5 > 0, 
a;~''T(a;) — > as a; — !> 00 (sec appendix) and 

- lim ilogE[T(n''e^"e-^^")e^^"] > -59 - lim - logE[e(^+'')^^"] . 

n— fcxD n n— >oo Ti 

Letting (5 — and using continuity of x, this ends up the proof. □ 



Proof of the lower hound of Theorem 1. First, we recall the following classical large deviation in- 
equality: 

^{Sn > On) < e-^(«)" (19) 

and we define the first time r„ when the random walk (Si : i < n) reaches its minimum value on 
[0,n]: 

Tn ■■= inf{0 <k<n: Sk ^ M„}. 
14 



We decompose the probability of having an extraordinarily large population according to Sn — Af„. 
P(Z„ > e"") = P(Z„ > e"", Sn - Mn > On) + E[P(Z„ > e'^"|n); Sn - Mn < On]. (20) 
The asymptotic of the first term can be found using (fT9|) (see [TT|): 

n 

P(Z„ > e^", S",, - Mn > On) < ^ P(Z, > 0, P(S'„ - S^ > On) 

i=l 
n 

< P(Z, > 0) exp(-(n - i)A{9n/{n - i))). 

i=l 

This ensures that 



liminf -- logP(Z„ > e«", Sn - Mn > On) > x{0), (21) 



where 



X(^) = ^inf Jt7 + (l-t)A(0/(l-t))}. 
For the second term, we use Theorem [2] and the Markov property for [Sn :n>Q): 

E[P(Z„>e«"|n);5„-M„<0n] 

< c nr^l E[T(n2/(^-i)e-^^"e«")e-^^"e^(^"-^^"-«"); 5„ - Af„ < On 

n 

= c 71^/51 ^E[T(n2/(^-i)e-^-e''")e^-e'3(^"-^--''");5„ - M„ < 0n,Tn = k 

n 

< c n^^^ ^E[T(n2/(^-i)e-^^e^")e^^rfe = fc]E[e-^(^"-^"-); 5„_fe < On,Mn-k > 0] 

fe=0 

Let 6 = 1/?!^ and = f^/el- Using that 

E[T(n2/(^-i)e-^'=e''")e^-Tfe = fc] = E[T(n2/(/3-l)e-^^''e«")e^^^Tfc = /li < E[T(n2/('3-i)e-^^''e''"^ 
and we deduce from that 

E[P(Z„>e''"|n);5„-Af„<H 

n me 

< cnr^l ^E[T(n2/(^-i)e-^^'^-e^")e^^'^-]^e-^(«-(-'™"P(5„_fc £ [nje, n(j + l)e), A/„_fe > O) 

fe=l j=0 
n me 

< c riT'^l ^E[T(n2/(''-^'e"*^'"e''")e*^'"]^e"'^(^"(-''+^)')"e"'^(-'''"/(""''))(""''' 

fe=l i=o 

-(/36+(l-t)A((e-s)/(l-t)))n\ 



< cOn'' sup |E[T(n2/(^-i)e-^^L-Je''")e*^L*.J 



e 



0<i<l,0<s<e 

Together with Lemma [U this yields 

liminf -i logE[P(Z„ > e^"|n); Sn - Mn < On] > i'{d), 

n— >oo n 

where 

i/'(0) = inf \-ft + (3s+{l-t)A{{e- s)/{l-t))}. 

a<t<l,Q<s<9 I J 

Combining this inequality with ([20]) and (|2ip gives 

liminf--logP(Z„ > e^") > min{x(6l); V'(6')}- 
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Adding that ^^{9) < x{0) since the infimum is considered on a larger set for 'ip than for x, we get 

limsup--logP(Z„ > e^") > 
which proves the lower bound of Theorem 1. □ 



5 Adaptation of the proof of the lower bound for /3 > 2 

First, Lemma [T] still holds for /3 > 2 by following the same proof. Indeed, using (|14p for /i = 1 
together with Lemma 2] given in the appendix ensures that 

P(Z„ > Oln) = 1 - /o „(0) > , > n"^ c-^e*^". 

The main difficulty is to obtain an equivalent of Theorem [51 For this, wc need to calculate higher 
order derivatives of go.n ^^nd the upper bound on the tail probability of Z„ contains an additional 
term: 

Theorem 3. Under assumption HiP) for some /? > 2, there are a constant < c < oo and a 
positive nondecreasing slowly varying function T such that for every k > I, 

P{Z,, > fc|n) < c e^"n^T(n2e-*^"fc)max{A;"'5e(''-i)(^"-*^");fc-r^l-ier'51(^"-^^")} a.s. 



For the proof, we use the functions 

(l-/fc(.5)) /fc(l)(l-s) 5fe(l)gfe(s)(l -s) 

and 

n-l 

H{s) = J2Ukhk+i{fk+i,n{s)) a.s. (0<s<l). (22) 

A:=0 

Then (jl4p with /i = 1 gives 

goA^y = , , = t/„ + (1 - s)g(s) a.s. (0<s<l) 

and calculating the ^-th derivative of the above equation, we get for alH > 1 and s S [0, 1), 

^goA^y = {l-s)H^'\s)-lH^'-'^is) a.s. (0 < s < 1). (23) 

The rest of the section is organized as follows. First, we prove the following technical lemma which 
gives useful bounds for power generating series. Then we derive Theorem [31 Finally the main 
lines of the proof of the lower bound of Theorem [1] for /3 > 2 are explained (following the proof for 
f3 G (1, 2]). For simplicity of notation, we introduce <c which means that the inequality is fulfilled 
up to a multiplicative constant c which does not depend on s, fc, I or lo. 

Lemma 2. Under assumption H(/3), for every I < — 1, 

.f^lil) <c n'-' e^"e('-i)(^"-^^") a.s. (24) 
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Moreover the following estimates hold a.s. for every s G [0, 1) respectively for I < \/3~\—2, I = 2 
and 1= 

|i/W(,s)| „'e'(^"-^^") (25) 

+nT{n\-''"{l ~ s)-'){l - s)-(r^l-/5)e-^"e(^-i)(^"-^^") (26) 
|i/W(,s)| n'e(r^l-i)(^"-^^")+n2T(n2e-^^"(l-s)-i) e-5"e/3(5"-M")(l _ s)-^^/^!-/?) 

+nT(n2e-^^"(l - s)-i) e-S"e(^-i)(^"-^^")(l - s)-'-<^^^^-^K (27) 



Proof. We prove the Lemma by induction with respect to I and ah the following relations hold 
a.s. for every s G [0, 1). For / — 1, ([M|) is trivially fulfilled since /q „(1) = e'^". First, we consider 
/ < \(3~\ — 2 and we assume that ([M)) holds for every i < I. We are first proving that (PS)) holds for 
I and then that ([241) holds for / + 1. 

By induction assumptions and monotonicity of generating functions and its derivatives, for alH < Z 
and s e [0, 1], 



/l!^i,„(s) < /Si,„(i) < 



71 e " 



^(i-l)(S„-Af„) 



<c n ' e~" e' 

Lemma El given in the appendix ensures that (see Lemma (5]) for the definition of Uj^i) 



(28) 



d}_ 

ds' 



hk+i{fk+i,n{s)) ^ \^h[^li{fk+iAs)hjdi-'' 

3 = 1 



and using 



By Lemma [5] also given in the appendix, for j < — 2, the derivatives h'"^^ are bounded by a 
constant that does not depend on w. Thus 



^fe+l(/fc+l,n(s)) 



Then recalling ([22]). we have 



A;=0 



which gives (gH) for Z 2. 

We can now prove that is fulfilled for I + 1 < \(3~\ — 1. Using Lemma [S] again (see (US])) with 
/ = go,n and h{x) = 1/x, we get 



^9oA^)'' = E(-l)(-2)---(-j)3o,n(.)-(^'+^^^.,,;(.s) 



= -aoA^r'gili^) + E(-i)(-2) • • • {-j)9oA^r^''-'^^M, (29) 

J=2 
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where 

i={ii,...,i2j)eC{j,l) 

and C{j, I) = {(ii, . . . , i2j)) 6 N^^ |iii2 + 13*4 + ... = / and 12 + 14 + . . . = .?}• 
Moreover, the induction assumption and ([55]) give for every i < Z — 1, 

Thus 

By 1221), the left hand-side of ^ is equal to (1 - - IH'^^-'^\s). By ([251), for I <\P]- 2, 

(1 — s)iJ'-'-'(s) vanishes for s = 1. Thus letting s = 1 and noting that go.n(l) = e^" yields 

i=2 

As we have already proved (^5]) for Z < — 2, we get 

Using (|35|). we get ((24)) for / + 1, which completes the induction and proves ([24]) for / < — 1. 
Let us prove the bound on H^'^s) for Z = - 2. Using again Lemmas [S] and [S] and 

yields 

|^/ifc+l(/fe+l,«(s)) 

<, „'-ie^"e(r^l-2)(^"-^^") + T(l/(1 - A+:,„(.)))(l - A.+i,„(.))-(r^l-^)(/^+i,„(.))'.(30) 

Now by the same arguments as in the proof of Theorem [51 T(l/(1 — fk+i.n{s))) < T(n^e^^^" (1 — 
s)~^) and by convexity, 

(1 - < (1 - 

Using also /fe+i_„(s) < e^""^^", by ^ follows 

Combining this inequality with ([^ proves (^5)) . 

This implies that (1 — s)H^^\s) ^> as s — > 1 for Z = \f3~\ — 2. Thus we can apply the same 
arguments to get an upper bound for go'ri(l) ^^"^ prove (1241) for I — [/?] — 1. 
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Finally, let / = — 1. We apply just the same arguments as before. Then Lemmas [5] and 
E] yield 

|^/lfc+l(/fe+l,n(s)) 
1-2 

= |E4+l(A+l,n(^))"..K^)+^Cl^(A+l.n(s))/f+\,„(^)(/Ul^„(s))'-' 

+41,(A+i,„(.))(/^+i,„(.))' 

Using again (f^ . this proves (P7)) . □ 

Proof of Theorem[3[ for /3 > 2. Let Z = — 1. Without loss of generality, we assume T > 1. The 
following relations hold a.s. Using and (P^ . 

Now using (gSl), (EH), (EH) as wcU as cxp(S'„) < cxp(S'„ - A/„) for the first terms and (EJ) together 
with ([55)1 for the last term yields 

+(1 - 5)i-(r/3i-«g/3(s„-M„) ^ _ ^^^r^i(s„-M„) 

+ (1 - s)-(r/51-/J)e(/3-i)(s,.-A/„) ^ e(r'31-i)('5"-*^")j 
+eS,.^ig(L/^J-i)(S„-A/„)^ 

Analogously to ([T5| . wc get the following estimate for every 1/2 < s < 1. 

> s'^^PiZ,,>k\U). 

Choosing s = 1 — 1/fc yields 

Using that for all a > 1 and 6 > 0, the function x — > a^^exp((x — 1)6) is monotone and that 
P <\P^ < + 1 <\P^ + have for aU fc > 1, 

fc-me(r/31-l)(S„-A/„) <j^^^|^-/3g(/J-l)(S„-A/„).^-r^il-lgr/31(S„-Af„)|^ 

Combining the two last inequalities leads to 

P(Z„ >fc|n) e^"n'T(n2e-^^"yfc)max{yfc-^e(^-i)(^"-^^");fc-r/'l-ier^l(^"-^^")}, 
which completes the proof. □ 
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Proof of the lower bound of Theorem 1 for f] > 2. The proof now follows the proof for /3 G (1,2]. 
Theorem [3] yields 

liminf-ip(Z„ > e^") > min {Vj^,/j.a(^), ^^J/SI+i.aI^)}, 

where ip is defined in Now using the characterization of tjj given in forthcoming Lemma |21 we 
deduce that for any > 0, 

■!/'7,/3,a(^) ^ '07,r^il + l,A(^')- 

Thus 

inin{V'7,/?,A(^): V'7,r,91+i,A(^')} = V'7,/3.a(6') ^tfjie) 
and we get the expected lower bound. □ 

6 Proof of the corollary 

By assumption, there exists a constant d < oo such that for every /3 > 0, 

P(L>z|/,L>0) < d ■ (77i A 1) • z"^ a.s. 

Then we can apply the lower bound in Theorem [T] for every /? > 0. This yields for all (3 > and 
6* > 0, 

liminf -- logP(Z„ > e^") > a a(0). 

n— >oo n 

Now taking the limit l3 —5- oo, the monotone convergence of yields 

liminf-ilogP(Z„ >e''") > V7,oo,aW, 

where 

V't.oo.aW lim inf {t^i + ps + {I - t)K{{e ^ s) / {I - t))] 

= inf {<7+(l-t)A(0/(l-t))|. 

This gives the upper bound and the lower bound follows readily the proof given in Section 3 where 
we consider the natural associated path (or see [H]). □ 

7 Appendix 

We give in this section several technical results useful for the proofs. 

7.1 Characterization of the rate function ip 

Lemma 3. Let < 7 < A(0) and /3 > 0. The function ip defined for 6 > by 

m = , inf ^ ^, {^7 + I3s+{1- t)A{{9 - - t))} 
is the largest convex function such that for all x,9 > 

-0(0) =7, i;{d)<A{9), i^{9 + x) <ij{9)+(3x. (31) 
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Proof. First, we prove that ip is convex. Using the definition of ip and the convexity of A, for any 
e',0" > and e > there exist t',t" £ [0,1) and s' S [0,61'], s" G [0,61"], such that for every 

Ae [0,1], 

x^{e') + (1 - A)^(0") 

>X[t'j + /3s' + {l-t')A{{9' -s')/{l-t'))] 

+ (1 - A)[t"7 + 13s" + (1 - t")A{{0" - .s")/(l - t"))] - e 

> [At' + (1 - X)t"]j + [Xs' + (1 - A)s"]/3 

' X0' + {I - X)0" - {Xs' + {I - X)s") 



+ (l- [A^' + (l-A)^"])A(- 
7/'(A6l'+(l-A)6l" 



1 - [Xf + (1 - A)<"] 

> 

Letting e — 5- entails that ■0 is convex. 

Second, foUowing the previous computation, we verify that ^ fulfills (|5T|). For any 6* > and e > 0, 
there exist t' £ [0, 1) and s' E [0,6*] such that 

i^{d) > t'-f + l3s' + {l-t')A{{e-s')/{l-t'))~e 

= t'j + Pis' + :e) + (1 - t')A{{e + X - [s' + x))/{l - t')) ^px-e 

> inf \t-f + P§+(l-t)A((e + x-S)/(l-t))]-Px-e. 

te[o.i].se[o,e+x] ^ ' 

Taking the limit e — > yields the second property in (j3ip . Furthermore, letting i = and s — 
implies ip{9) < A{9) and i — > 1 entails that iplQ) < 7. This completes the proof of (pij) . 

Finally, let k be any convex function which satisfies (PT|) . Using these assumptions ensures 
that for all t G [0, 1) and 0< s <9, 

tj + ps + {l-t)A((e-s)/{l-t)) > tK{Q) + l3s + {l-t)K{{0-s)/{l-t)) 

> Ps + K{tQ+{l-t){6-s)/{l-t))) 
= Ps + k{9-s) 

> k{0). 

Taking the infimum over s and t, we get i^{0) > k{6) and the proof is complete. □ 

We give now describe a last characterization of 1/' that results from Lemma [3] (see Figure [3]). Let 
9* and 9'^ be defined as in ([5]) and © and assume < 9* < 9"^ < 00. As convex and monotone 
function, A has at most one jump (to infinity). Let this jump be in < 9j < 00 and A(9) is 
diflterentiable for 9 < 9j. As A is also continuous from below, A{9j) < cxd. Now. by the preceding 
characterization, ijj is the largest convex function, starting in 1^(0) = 7, being at most as large as 
A and having at most slope /3. 

The largest convex function through the point (0,7) being smaller/equal than A has to be linear 
and has to be a tangent of A. By definition of 6**, the tangent at A in 9* goes through the point 
(0,7). Thus Ip is linear for 9 < 9* and follows this tangent. For 9 > 9* , ijj is identical with A 
until the slope of A is exactly /3 (or until A jumps to infinity). At this point 9'^ , the last condition 



21 



becomes important and ip is linear with slope p for 9 > 9^ . Summing up, 

7(i-f) + ^A(r) , if0<r 

ipi9) = { A{9) , if 6** < 61 < 6it . 

/3(6' - 6it) + A(6it) , if9>9^ 

If A'(0) > then 6*^ = and = 7 + /36'. If 7 = A(0), then 9* = 0. We refrain from describing 
other degenerated cases. 

7.2 Slowly varying functions 

In this section, we recall some properties of regularly varying functions and we refer to [9] for 
details. The function T : (0, oo) (0, oo) is a slowly varying function if for every a > 0, 

We need a Taubcrian result from [16], p. 423. See also [9], Theorem 1.5.11, page 28. For any 
a > — 1. the function 17(5) X^feLo satisfies 

.g(s) -r(a + l)(l-s)-i-" (s^l-). 

Then the function ^ = s — > (1 — s)^+"(7(s) is continuous on [0,1) and has a finite limit in 1 — . 
Denoting by M the supremum of this function extended to [0, 1], we get 

CJO 

^s'^fc" <M(l-s)-i-" (0<s<l). 

k=l 

For a ~ —1, X^fcLi s'^/fc = — log(l — s). As the logarithm is a slowly varying function, we rewrite 
the previous results in the following way, which will be convenient in the proofs. 
There exists a nondccreasing positive slowing varying function T such that for all a > —1 and 
s e [0, 1) 



^s'^fc" < T(l/(l-s))(l -s)-i-". (32) 
fc=i 

7.3 Bounds for generating functions 

Let L be a random variable with values in {0,1,2,...} with expectation m, distribution {pk)kefi 
and generating function /. Let us define 

Qk :=P(L> fc|/) 
and the following function associated to /, 

k=0 

where the last identity comes from Cauchy product of power series (see also [H]). We recall that 
the /-the derivative of a function / is denoted by /^'^ and that /'■'-' (s) and (/'■'^(s) exist for every 
s 6 [0,1). As 



5(.):=EA. = ^Y^, (33) 



/«(s) = ^ fc(fc - 1) • • • (fc - Z + 1)3"-%, g^'Hs) = 5^ fc(fc - 1) • • • (ft - / + l)s''-'qk, 



k=0 fe=0 
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all derivatives of / and g arc nonnegative, nondecreasing functions. We are using g instead of 
/ in the proofs since the associated sequence {qk)keTi is monotone, which is more convenient. 
Calculating the l-th derivative of f{s) = 1 — (1 — s)g{s) gives 

= (34) 

Thus and /'-''(l) both essentially describe the l-th moment of the corresponding proba- 

bility distribution. More precisely, if ^('"^^(l) is finite, then /^'-'(l) is finite and 

= lg^'-'\l). (35) 

Conversely if /(')(!) 

< oo, then 



^'"'Hl) = ^ fc(fc - 1) . • . (fc - / + l)qk < k'pk < OO 
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k=l k=l 



and ^('"^'(l) < oo. 

For ^ G (0, 1], we also define the function 

g{lY-g{sY 
(.9(l).g(s)(l - s)Y 

The following useful lemmas give versions of assumption H(/?) in terms of the function /i^. Noting 
that (7(0) = 90 = '^{L > 0|/) and g(l) = to, we can rewrite assumption 7^(/3) in the following way 

% < d .9(0) (.9(1) A 1) k-f" (k > 1). (37) 

Lemma 4. Let j3 > 1 and assume that ^37^ holds for some constant < d < 00. Then for every 
< /X < (/? — 1) A 1, there exists a constant c ~ c(/3, d, ^) such that for every s e [0, 1], 

h^{s) < c. (38) 

The above bound also holds for jJL = 1 if 13 > 2. Moreover, if (3 G (1,2], there exists a nondecreasing 
positive slowly varying function T = T(/3, d) such that, for every s e [0, 1), 

hp.,{s) < T(l/(l-s)) (39) 
-h'^-i{s) < T{l/{l-s))/{l-s). (40) 

Note that T depends on L (or g) only through the values of d and /3. Then under assumption 
HiP), we derive from this lemma a nonrandom constant bound. 

In the proofs, we use again the notation <c which means that the inequality is fulfilled up to 
a multiplicative constant which depends on /? and fi but is independent of s and the order of the 
differentiation. 

Proof. Using g(s) > g{0), we have 

g{ir~g{sr 



{g{l)g{s){l - s)Y 
- {g{l)g{0){l ~ s)y 



(1 — s)^ 
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Since ^ G (0, 1], the function a; a;^ is concave, so that a'^ — < fix^^ ^{a — x) for all < a; < a. 
Moreover 

oo oo 

1 = qo/g{0) <^-^Yl s^lkgiO)-' < « - E 9k9{0)-\ (42) 

k=0 k=Q 

Then a;^"^ < 1 and using the inequality of concavity in (pij) with qk < dg{0) ■ (.g(l) A 1) ■ k^^ leads 
to 



(l-s) 
(1 - sY 



k=i ' ' 



oo k — 1 

j 



oo oo 



oo 

The estimates ([55]) and ([5^ on /i^ for < /i < (/3 — 1) A 1 and /i = /3 — 1 now follow directly from 
([5^ . For fj, = 1, f3 > 2 and s = 1, the sum is finite and (|55)) also holds in this case. 

For the second part of the lemma, we explicitly calculate the first derivative of by using 
the formula 



hfi.,{s)g{sf-' 
Differentiating both sides yields 

hi3-i[s)g[sr +(p-l)/i/3-i(s)ff(s)'^ g [s) = g(l)^-i(l - sy 

and thus 



g{s) g{s)g{l)0-^l - sr~^ gis^-^giiy-^l - J 

As g is nondecreasing, we can skip the the last term which is negative. Using ([37]) and p9p . we 
get 

, , ^ g(0) ■ (.9(1) A 1) ■ Er=i ks'^-'k-P f^,^ I ^ 

- Vi(-) <c (T(l/(1 - s)) + 

Moreover g{s) > g{0) and .9(1)"^'^"^) • (5(1) A 1) < 1 for /3 - 1 G (0, 1], so 

00 ^ 

-h',.,{s) 5: .'^-ifc-^+i (t(1/(1 - ,s)) + (^^^ 



The result now follows from (|32)) and the fact that the product of two slowly varying functions is 
still slowly varying. □ 
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We consider now 

his)^h,is)- 5(1) 



Lemma 5. We assume that ^37^ holds for some /3 > 1. Then there exists a finite constant 
c = c(/3, d) < oo such that for every s G [0, 1), 

<c if 0<l<f3-2 

|/j(r/31-2)(5)| < cT(l/(l-s)) (l-s)-(r/31-/3) if p>2 

|/j{r/31-i)(5)| < c T(l/(l-s)) (l-s)-i-(r^T-'^). (43) 
Proof. By and Cauchy product of power series, for every s £ [0, 1), 

g{s)g{l)h{s) = g(l)-.9(-^) ^ + g,^, + . . .). 

1 — s ■'^ — ' 

fc=0 

Thus, the l-th derivative of g{s)h{s) is 

E = .9(1)-' fc(fc - 1) • • ■ (fc - Z + + + ...). 

j=o k=a 

Moreover, (|57)) ensures that for all s G [0, 1) and j < /3 — 2, 

oo 

< 5^^'ni) < E ff(0)(5(l) A 1) 

k=0 

Combining the two last expressions and using g{s)~^ < g(0)~^ gives 

oo oo ^ / 7 \ 

\h^'Hs)\ <, g(s)-i(.9(l)-\9(0).(.g(l)Al).Efc'^'"' E + E ■)-9^-''^(l)l'^^'"''(^)l) 

oo oo ^ / 7 \ 

<c E^'^'"' E r^ + Ei )i'^^'"^^(^)i) (44) 

fc=0 j=k+l j = l ^-'^ 

We can prove the first statement of the lemma by induction on I. For / = 0, it is given by Lemma 
m Assuming that the bounds holds for T < Z < /3 — 2, the previous inequality ensures that 

i-i 

\h^'Hs)\ 1 +Ei'^''ns)i 

since X^fcLo ^' This ends up the induction and proves the first estimate in (|43p . 

We consider now I = [/?] — 2 and 'continue the induction'. Using the bound of /i^'^ for Z < /3 — 2 
and dm) yields 

oo oo oc oo 

|/i^'Hs)i <cE^'^' E r'" + i<cE^'^^''^"''^"^^' + i^=E^''^"^'"*^^^"^"- 

fc=0 j=fc+l fc=l k=l 

Then the second estimate of the lemma follows from ([5^ . 
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Finally, we prove the bound for / — \f3] ~ 1 in the same way. By 

oo oo 

oo oo 

oo 
k=l 

and Lemma [32] allows us to conclude. □ 

7.4 Successive Differentiation for composition of functions 

For the proof of the upper bound on the tail probabilities when /3 > 2, we need to calculate 
higher order derivatives of a composition of functions. Here we prove a useful formula for the l-th 
derivative of a composition of two functions, which could also be derived from the combinatorial 
form of Fa di Bruno's formula. 

Lemma 6. Let f and h be real-valued, l-times differ entiable functions. Then 

- jZh'^'\f{s))u,,{s), (45) 

where Uj^i{s) is given by 

i=(ii,...,i23)eC(i,i) 

with some constants < q < oo and C{j, I) defined by 

C{j,l) := {{ii, . . . ,i2]) €^'^^\iii2 + izii + ■ ■ ■ = I and 12 + 14 + ■•■=.?} . 



Proof. We prove the formula by induction with respect to I. For / = 1, by chain rule of dif- 
ferentiation, (|45l) is fulfilled. Assume that (|45)) and (|46| hold for /. Then by product rule for 
differentiation, 

d'+i ^f.,,.,....d 



jh{f{s)) = Y,(h(^)(f{s))-u,A.s)+u,As)f'i^)h^''''Hm) 



Now 



with new constants given by 



l£C{j+l,l+l) 



c 



+1) , if ii = 42 = 1 



, else 



26 



Furthermore, 




l)(s)...(/fe,^.)(5)y2. 



with some new constants < Ci < oo. This ends up the induction. 



□ 
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